Papers by Michael J Ryan
To Lie or Not to Lie? Investigating The Biased Spread of Global Lies by LLMs (2026.acl-long)
Copied to clipboard
Zohaib Khan, Mustafa Dogan, Ifeoma Okoh, Pouya Sadeghi, Siddhartha Shrestha, Sergius Justus Chesami Nyah, Mahmoud O. Mokhiamar, Michael J Ryan, Tarek Naous
| Challenge: | Misinformation is on the rise, and the strong writing capabilities of LLMs lower the barrier for malicious actors to produce and disseminate false information. |
| Approach: | They introduce a multilingual parallel dataset of 440 misinformation generation prompt templates and 6,867 entities, spanning 8 languages and 195 countries. |
| Outcome: | The proposed model reduces misinformation generation across languages and countries . it also reduces the risk of misinformation being spread across countries based on the model's performance . |
AudioJudge: Understanding What Works in Large Audio Model Based Speech Evaluation (2026.eacl-long)
Copied to clipboard
Potsawee Manakul, Woody Haosheng Gan, Michael J Ryan, Ali Sartaz Khan, Warit Sirichotedumrong, Kunat Pipatanakul, William Barr Held, Diyi Yang
| Challenge: | Current speech evaluation systems rely on specialized systems for individual audio characteristics and poor correlation between automatic methods and human preferences. |
| Approach: | They propose a unified evaluation framework for Large Audio Models as a Judge, AudioJudge . they propose specialized judges that can be prompted to perform audio characteristic detection tasks . |
| Outcome: | The proposed method improves performance across audio characteristic detection and human preference simulation tasks. |
Mind the Gap: Static and Interactive Evaluations of Large Audio Models (2025.acl-long)
Copied to clipboard
Minzhi Li, William Barr Held, Michael J Ryan, Kunat Pipatanakul, Potsawee Manakul, Hao Zhu, Diyi Yang
| Challenge: | Recent work has focused on evaluating large audio models (LAMs) that directly accept audio inputs. |
| Approach: | They propose an interactive approach to evaluate large audio models and collect 7,500 LAM interactions from 484 participants. |
| Outcome: | The proposed model is based on a set of user-generated audio interfaces with 7,500 interactions from 484 participants. |
Distilling an End-to-End Voice Assistant Without Instruction Training Data (2025.acl-long)
Copied to clipboard
| Challenge: | Recent efforts to train speech-only LLMs have led to models “forging” speech information from text-only models. |
| Approach: | They propose a paradigm for training Speech Large Language Models without instruction data by using the response of a text-only LLM to transcripts as self-supervision. |
| Outcome: | The proposed model generalizes to Spoken Question Answering, Classification, and Translation and achieves a 72% win rate compared with state-of-the-art models like Qwen 2 Audio . |
SynthesizeMe! Inducing Persona-Guided Prompts for Personalized Reward Models in LLMs (2025.acl-long)
Copied to clipboard
| Challenge: | Recent calls for pluralistic alignment of Large Language Models encourage adapting models to diverse user preferences. |
| Approach: | They propose a method to induce synthetic user personas from user interactions for personalized reward modeling. |
| Outcome: | The proposed approach improves LLM-as-a-judge accuracy by 4.4% on Chatbot Arena. |
LangProBe: a Language Program Benchmark (2025.findings-emnlp)
Copied to clipboard
Shangyin Tan, Lakshya A Agrawal, Arnav Singhvi, Liheng Lai, Michael J Ryan, Dan Klein, Omar Khattab, Koushik Sen, Matei Zaharia
| Challenge: | Composing language models into multi-step language programs is a mainstream paradigm for building AI systems, but tradeoffs in this space have only scarcely been studied before. |
| Approach: | They propose a benchmarking tool to evaluate the architectures and optimization strategies for language programs . they find that optimized language programs offer strong cost-quality Pareto improvement . |
| Outcome: | The proposed framework evaluates the impact of program architectures and optimizers on quality and cost. |